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Technical Field 

The present invention relates to technology in which an arbitrary video is 
retrieved and viewed from a plurality of video groups and, more particularly 
to a video viewing system and method thereof for viewing information on 
video production. 
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Background Art 

For the purpose of more adequately describing a technological level 
for the present invention at the present time, all descriptions of the patents, 
patent applications, patent gazettes, scientific papers, and the like which are 
15 quoted and identified in the present application will be incorporated by 
reference herein. 

First, in the following description, an underlying video which is 
typified by videos, and the like taken on site is called a "raw material video**, 
a video in which the raw material video is edited and produced is called an 

20 "edited video", and a video which is finally broadcast based on the edited 
video is called an "on-air broadcast video", respectively. 

In general, editing work is indispensable to video production, and all 
the videos taken on site are directiy used on rare occasion. And, in 
broadcasting the edited videos, broadcast stations may cut the videos 

25 halfway due to time restriction, or may run a telop. For this reason, all the 
videos acmally sent on the air do not coincide with the edited videos. 
When these on-air broadcast videos and edited videos are stored, from which 
necessary portions are selected to produce a new video, it is necessary that 
video groups which are made into them be managed and target videos be 

30 able to be retrieved and viewed. 

An example of such a video viewing system is disclosed in the Japanese 
Unexamined Patent Publication No. ll(1999)-266422. In the broadcast 
program management system disclosed in the above patent gazette, 
association between a complete package (on-air broadcast video)and a 

35 source matoial (edited video) is stored in memory beforehand. To be more 
precise, complete package data stored in memory is divided into a shot for 
each cut, a similarity between a video of this complete package shot and a 
video section in a source material is determined using a correlation value of 
a frame image. Thus, video section information for each complete package 

40 shot and video section information for the source material, which have been 
determined on the similarity therebetween may be brought into association 
(refer to paragraph number 0048 to 0058, and FIG 10 and FIG 11 in the 



^ aforementioned patent gazette). Based on this complete package and 
source material related data, it is possible to retrieve and reproduce the 
source material video section correlating to any complete package video 
section to each other (refer to paragraph number 0060 and 0061, and FIG 12 
5 in the aforementioned patent gazette). 

Problems to be Solved by the Invention 

However, the aforementioned conventional system is not taking 
access to a raw material video related to an on-air broadcast video and edited 
10 video into account. The raw material video should be used in accordance 
with various aims, but is a matrix of the subsequent video production, as 
well as a precious video group providing a primary source. 

For example, an edited video is produced using part of a raw material 
video in accordance with awareness of the issues or intension on each 
15 occasion, but the awareness of the issues changes with time, and another 
portion of the same raw material video might be recognized as an important 
scene. Taking news for example, even though news to be broadcast on the 
same date can be produced with the reuse of an edited video, the edited 
video alone is insufficient for producing more detailed contents such as 
20 feature programs at a later date, and thus necessary videos are often found 
back to the raw material video. 

In this way, a grasp of the usage status of a raw material video 
becomes important, for example, when only used portions are collected to 
produce new contents, or when unaired portions are used to produce new 
25 contents by contraries. The aforementioned conventional system can only 
reproduce the edited video correlating to the on-air broadcast video, and not 
grasp which part of the raw material video is used in which video. 

Furthermore, the conventional system can only reproduce the edited 
video correlating to the on-air broadcast video, but not grasp how often 
30 which part of the video is used. Frequency-of-use is one important 
criterion in selecting portions necessary for the video production. There is 
even a case in which only portions with much frequency-of-use are used to 
produce a digest. On the other hand, there may be a case in which less used 
portions or no used portions are utilized to produce new contents. In any 
35 event, the conventional system does not contribute to improved production 
efficiency in making an attempt to produce a new video in response to such a 
demand, at all. 

Accordingly, an object of the present invention is to provide a video 
viewing system and method thereof for enabling an easy grasp of the usage 
40 status of a plurality of video groups. 

Another object of the present invention is to provide a video viewing 
system and method thereof for enabling the frequency-of-use of a video to 
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♦ view. 

Still another object of the present invention is to provide a video 
viewing system and method thereof for enabling increased production 
efficiency by easing access to a portion with high (or low) frequency-of-use. 

5 

Disclosure of the Invention 

According to a video viewing system of a first aspect of the present 
invention, a video of any one video group of a first video group, and a 
second video group produced by use of said first video group is specified, 

10 whereby frequencyK)f-use in other video groups of said specified video is 
found and displayed. 

According to a video viewing system of a second aspect of the 
present invention, a video of any one video group of a first video group, a 
second video group produced by use of said first video group, and a third 

15 video group produced by use of said second video group is specified, 
whereby the firequcncy-of-use of said specified video in other video groups 
having a correlation with said specified video is found and displayed. 

A video viewing system according to a third aspect of the present 
invention includes a first storage unit which stores to enable retrieval of a 

20 plurality of video groups having a series of correlations that at least one 
video of one video group is used to produce a video of the next video group, 
a second storage unit which stores to enable retrieval of mutual correlations 
obtained firom said series of correlations, a firequency-of-use generation unit 
which upon specification of a video of any one video group of said plurality 

25 of video groups, retrieves a correlation with respect to said specified video 
firom said second storage unit to generate tiie frequency-of-use of said 
specified video in oth^ video groups based on the retrieved correlation, and 
a control unit which displays said frequency-of-use on a display unit. 

It is preferable that said second storage unit store to enable retrieval 

30 of correlation information showing that each video section correlates to one 
video section of other video groups for each of said plurality of video 
groups. 

Said firequency-of-use gen^ation unit might be configured so as to 
have a retrieval unit which upon specification of a video of any one video 

35 group of said plurality of video groups, retrieves correlation information on 
said specified video from said second storage unit to identify a used video 
section in other video groups of said specified video, and a frequency-of-use 
calculation unit which generates the frequency-of-use of said specified video 
in said other video groups based on said used video section. 

40 Said control unit might graph and display the frequency-of-use of 

said specified video in said other video groups based on the video section of 
said specified video. 



Moreover, it is preferable that said control unit display a pointer 
movable in a time axis direction of the video section of said specified video 
together with said graphed frequency-of-use, and display said specified 
video from the time position indicated by said pointer when said pointer is 
opiated. 

A video viewing method according to a fourth aspect of the present 
invention con:q)rising: 

a) storing to enable retrieval of a plurality of video groups having a series of 
correlations that at least one video of one video group is used to produce a 
video of the next video group; 

b) storing to enable retrieval of correlation information which is generated 
from said series of correlations and which shows that each video section 
correlates to one video section of other video groups for each of said 
plurality of video groups; 

c) retrieving, upon specification of a video of any one video group of said 
plurality of video groups, correlation information on said specified video to 
identify a used video section in other video groups of said specified video; 

d) generatmg the frequency-of-use of said specified video in said other video 
groups based on said used video section; and 

e) displaying said frequency-of-use on a display unit. 

In said step d), said frequency-of-use might be generated by 
identifying the used frame number of said specified video from said used 
video section, and counting said used frame number in all used video 
sections in said other video groups. 

According to a fifth aspect of the present invention, in a video 
viewing method for viewing a desired video from a plurality of videos, a 
video of any one video group of a first video group, and a second video 
group produced by use of said first video group is specified, whereby 
frequency-of-use in other video groups of the specified video is found and 
displayed. 

The frequency-of-use of said specified video in said other video 
groups may be found based on a used video section in other video groups of 
said specified video. Said used video section may be identified based on 
correlation information showing that each video section correlates to one 
video section of other video groups for each of a plurality of video groups 
having a aenes of correlations that at least one video of one video group is 
used to produce a video of the next video group. The frequency-of-use of 
said specified video in said other video groups may be graphed and 
displayed based on the video section of said specified video. 

It is possible that a pointer movable in a time axis direction of the 
video section of said specified video is displayed together with said graphed 
frequency-of-use, and tiiat said specified video is displayed from the time 



• position indicated by said pointer when said pointer is operated. 

Said frequency-of-use may be sorted and displayed in any one of 
ascending order and descending order. 

According to a sixth aspect of the present invention, in a video 

5 viewing method for viewing a desired video from a plurality of videos, a 
video of any one video group of a first video group, a second video group 
produced by use of said fu^t video group, and a third video group produced 
by use of said second video group is specified, whereby the frequency-of-use 
of said specified video in other video groups having a correlation with the 

10 specified video is found and displayed. 

The frequency-of-use of said specified video in said other video 
groups may be found based on a used video section in other video groups of 
said specified video. Said used video section may be identified based on 
correlation information showing that each video section correlates to one 

15 video section of other video groups for each of a plurality of video groups 
having a series of conrelations tiiat at least one video of one video group is 
used to produce a video of the next video group. The frequency-of-use of 
said specified video in said other video groups may be graphed and 
displayed based on the video section of said specified video. 

20 It is possible that the pointer movable in the time axis direction of the 

video section of said specified video is displayed together with said graphed 
frequency-of-use, and that said specified video is displayed from the time 
position indicated by said pointer when said pointer is operated. 

Said frequency-of-use may be sorted and displayed in any one of 

25 ascending order and descending order. 

According to the present invention, when a video on the part of being 
used is specified, the frequency-of-use information thereof is generated, 
visualized, and displayed. For this reason, the usage status of a plurality of 
video groups may be easily grasped. 

30 Furthermore, a pointer which is movable on a time axis is provided 

on a screen which displays the frequency-of-use, and operated with a 
mouse, and the like, thereby providing ease of access to a portion with high 
(or low) frequency-of'Use to achieve increased production efficiency. 

35 Brief Description of the Drawings 

HG. 1 is a block diagram showing the configuration of a video 
viewing system according to a first embodiment of the present invention. 

FIG 2A is a diagram showing an example of the on-air broadcast 
video correlated information format in the first embodiment. 
40 FIG 2B is a diagram showing an example of an edited video 

correlated information format. 

FIG 2C is a diagram showing an example of a raw material video 
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' correlated information format. 

FIQ 2D is a diagraro showing an example of a general-purpose 
correlation information format. 

FIG. 3A is a schematic view showing an example of the storage table 
5 of the on-air broadcast video correlated information in the first embodiment. 
FIG 3B is a schematic view showing an example of the storage table of 
edited video correlated information. 

FIG 3C is a schematic view showing an exan^le of the storage table of raw 

material video correlated information. 
10 FIG 4A is a schematic view showing a correlation between the on-air 

broadcast video and the edited video, and a correlation between the edited 

video and the raw material video in the first embodiment. 

FIG 4B is a schematic view showing a correlation between an on-air 

broadcast video and an edited video and a raw material video. 
15 FIG 5 is a diagram showing a display example of viewing the raw 

material video correlated information in the first embodiment of the present 

invention. 

FIG 6 is a diagram showing a display example of viewing the edited 
video correlated information in the first embodiment of the present 
20 invention. 

HQ 7 is a diagram showing a display example of viewing the on-air 
broadcast video correlated information in the first embodiment of the present 
invention. 

FIG 8 is a diagram showing a display example of viewing the raw 
25 material video correlated information including the frequency-of-use 
information in the first embodiment of the present invention. 

FIG. 9 is a schematic view showing an example of the op^ation 
screen of flie video viewing system according to the first embodiment of the 
present invention. 

30 FIG 10 is a flow chart showing the overall operation of the first 

embodiment of the present invention. 

FIG 11 is a schematic view showing an example of the storage 
table of the raw material video correlated information in the first 
embodiment of the present invention. 
35 FIG 12 is a fi:equency-of-use table showing the result counted for 

each frame in the first embodiment of the present invention. 

FIG 13 is a graph in which the frequency-of-use table of FIG 12 is 
visualized. 

FIG 14 is a block diagram of a video viewing system according to a 
40 fourth embodiment of the present invention. 

Best Mode for Carrying Out the Invention 
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(First Embodiment) 

A: System Configuratioii 

FIG. 1 is a block diagram showing the configuration of a video 
viewing system according to a first embodiment of the present invention. 
In FIG 1, an entry unit 101 comprises an input device such as a keyboard 
and a pointing device, in which selection of a video to view or various 
instructions may be entered. A display unit 102 is a monitor, which 
displays a video viewing screen described later, and provides a graphical 
user interface in cooperation with the entry unit 101. 

The video viewing system according to the present embodiment 
includes a program control processor 103 which controls video viewing 
related processing or the action of the entire system by executing a control 
program 104, a video retrieval unit 105, a video storage unit 106, a 
correlation information retrieval unit 107, a correlation information storage 
unit 108, and a frequency-of-use calculation unit 109. The video retrieval 
unit 105, the correlation information retrieval unit 107, and the 
frequency-of-use calculation unit 109 execute video retrieval, correlation 
information retrieval and a frequency-of-use calculation described later 
under the control of the program control processor 103, respectively. 

In the video storage unit 106, there are stored an on-air broadcast 
video group (OA), an edited video group (ED), and a raw material video 
group (RAW). The raw material video group (RAW) involves storage of 
the raw material video filmed on-site, for example, as digital image data, and 
each raw material video thereof is managed together with a unique 
identification. In addition, retention of video related information such as a 
title, and production date and time is also possible. 

The edited video group (ED) involves storage of a broadcast video in which 
the raw material video is carefully selected and edited, for example, as 
digital image data, and each edited video thereof is managed together with a 
unique identification. In addition, the retention of the video related 
information such as a title, and production date and time is also possible. 

The on-air broadcast video group (OA) involves storage of a finally 
broadcast video, for example, as digital image data, and each on-air 
broadcast video thereof is managed together with a unique identification. 
In addition, the retention of the video related information such as a title, and 
production date and time is also possible. 

Upon receiving a video retrieval command from the program control 
processor 103, the video retrieval unit 105 retrieves the video data 
correlating to the specified video identification from the video storage unit 
106. The retrieved video data is displayed on the display unit 102 in 
conjunction with video data related information described later. When the 
video retrieval command contains the starting position of a video, the 



• retrieved video may be reproduced from the starting position, or the selected 
video may be located at the starting position. 

In the correlation information storage unit 108, there are stored on-air 
broadcast video correlated information (OA-REL), edited video correlated 

5 information (ED-REL), and raw material video correlated information 
(RAW-REL). The correlation information will be described in detail later. 

Upon receiving the correlation information retrieval command, the 
correlation information retrieval unit 107 retrieves correlation information 
on the specified video from the correlation information storage unit 108. 

10 The retrieved correlation information is displayed on the display unit 102 in 
a predetermined form as will hereinafter be described. On this occasion, a 
pointer providing access to other correlating videos is displayed together. 
The fi-equency-of-use calculation unit 109 calculates how many times a 
frame contained in the raw material video is used in the edited video or the 

15 on-air broadcast video, while referring to the aforementioned correlation 
information. The calculated frequency-of-use is graphed and displayed on 
a predetermined window on the display unit 102. The frequency-of-use 
calculation will be described in detail later. 

20 B: Correlation information 

FIG 2A is a diagram showing an example of an on-air broadcast 
video correlated information format. 

FIG 2B is a diagram showing an example of an edited video 
correlated information format. FIG 2C is a diagram showing an example 

25 of a raw material correlated information format. FIG. 2D is a diagram 
showing an example of a general-purpose correlated information format. 

As shown in FIG 2A, the on-air broadcast video correlated 
information is the information in which a correlation between the on-air 
broadcast video and the edited video and the raw material video is described. 

30 More specifically, which part of one on-air broadcast video is quoted from 
which part of which edited video or raw material video is described. The 
on-air broadcast video correlated information is composed of six columns, in 
which an on-air broadcast video identification is described in column 
number 1, the start frame number of an on-air broadcast video section in 

35 column number 2, the correlating video identification in column number 3, 
the correlating video type (edited video or raw material video) in column 
number 4, the start frame number of the video section of the correlating 
video in column number 5, and the number of frames of the video section 
thereof in column number 6, respectively. Such a description makes it 
40 possible to identify that one video section of one on-air broadcast video 
correlates to which video section of the edited video or the raw material 
video. 
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Note that a correlation with respect to each on-air broadcast video 
may be stored in separate correlation information files respectively, or the 
correlation with respect to each on-air broadcast video may be stored in one 
correlation information file. For example, a correlation with respect to an 

5 on-air broadcast video A may be stored in a correlation information file a, a 
correlation with respect to an on-air broadcast video B may be stored in a 
correlation information file b, and correlations with respect to both the on-air 
broadcast video A and B may be stored in one correlation information file. 

As shown in FIG. 2B, the edited video correlated information is the 

10 information that describes which part of one edited video is used in which 
part of which on-air broadcast video, or which part of one edited video is 
quoted from which part of which raw material video. The edited video 
correlated information is composed of six columns, in which an edited 
video identification is described in column number 1, the start frame 

16 number of an edited video section in column number 2, the correlating video 
identification in column number 3, the correlating video type (on-air 
broadcast video or raw material video) in column number 4, the start frame 
number of the video section of the correlating video in column number 5, 
and the number of frames of the video section thereof in column number 6, 

20 respectively. Such a description makes it possible to identify that one video 
section of one edited video correlates to which video section of the on-air 
broadcast video or the raw material video. 

As shown in FIG 2C, the raw material video correlated information 
is die information that describes which part of one raw material video is used 

25 in which part of which edited video or on-air broadcast video. The raw 
material video correlated information is composed of six columns, in which 
a raw material video identification is described in column number 1, the start 
frame number of a raw material video section in colunm number 2, the 
correlating video identification in column number 3, the correlating video 

30 type (edited video or on-afr broadcast video) in colunm number 4, the start 
frame number of the video section of the correlating video in colunm 
number 5, and the number of frames of the video section thereof in column 
number 6, respectively. Such a description makes it possible to identify 
that one video section of one raw material video correlates to which video 

35 section of the edited video or the on-air broadcast video. 

In place of the respective correlation information formats shown in 
FIG 2A to FIG 2C, one format shown in FIG 2D may be used. Namely, as 
a general-purpose format, a reference source video identification is described 
in column number 1, a reference source video type (on-air broadcast video, 

40 edited video, or raw material video) in column numba- 2, the start frame 
number of a reference source video section in column number 3, a referent 
video identification in column number 4, a referent video type (on-air 
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' broadcast video, edited video, or raw material video) in column number 5, 
the start frame number of a referent video section in column number 6, and 
the number of frames of the video section thereof in column number 7, 
respectively. 

5 FIQ 3A is a schematic view showing an example of the storage table 

of the on-air broadcast video correlated information. HG 3B is a 
schematic view showing an example of the storage table of the edited video 
correlated information. FIG 3C is a schematic view showing an example 
of the storage table of the raw material video correlated information. 

10 As shown in FIG 3A, the on-air broadcast video correlated 

information is stored for each on-air broadcast video section of each on-air 
broadcast video in the form shown in FIG 2A. For example, a stored 
record 1 indicates that four frames long from a third frame of an on-air 
broadcast video OAl are equivalent to four frames long from a third frame 

15 of an edited video EDI. Similarly, a record 2 indicates that 10 frames long 
from a seventh frame of the same on-air broadcast video OAl are equivalent 
to 10 frames long from a fifth frame of an edited video ED2. The tables in 
FIG 3B and FIG 3C are exactly alike. 

20 C: Generation of correlation information 

First, information showing a correlation that which part of one edited 
video is quoted from which part of which raw material video is called edited 
video-to-raw material video correlation information (ED-RAW correlation 
information). For this information, it is advisable to record the raw 

25 material videos selected during the editing stage in the system. In addition, 
information showing a correlation that which part of one on-air broadcast 
video is broadcast with the use of which part of which edited video is called 
on-air broadcast video-to-edited video correlation information (OA-ED 
correlation information). For this information, it is advisable to record the 

30 edited videos actually selected during the on-air stage in the system. 

Note that if there are no records of the ED-RAW correlation 
information or OA-ED correlation information, for example, they may be 
automatically generated by associating moving image units having similar 
diaracteristics using the moving inuige search technology disclosed in the 

36 Japanese Unexamined Patent Publication No. 2002-58049. 

FIG 4A is a schematic view showing a correlation of the on-air 
broadcast video-to-edited video and a correlation of the edited video-to-raw 
material video. FIG 4B is a schematic view showing a correlation of the 
on-air broadcast video-to-edited video-to-raw material video. 

40 As shown in FIG 4A, the OA-ED correlation information is first 

referred to retrieve each video section in edited video data used in the on-air 
broadcast video. Then, each video section in raw material video data 



. (hereinafter, referred to as a raw material video section) correlating to the 
edited video section may be identified with respect to each edited video 
section retrieved, by looking into the edited video correlated information 
including the edited video section from the ED-RAW correlation information. 

5 By associating this identified raw material video section with the 
aforementioned on-air broadcast video section, the OA -RAW correlation 
information may be obtained. As shown in FIG. 4B, if the raw material 
video section correlating to a specific on-air broadcast video extends over a 
plurality of the raw material videos, a correlation with the on-air broadcast 

10 video should be described for each correlating video section of each raw 
material video (refer to FIG 3 A to HG 3C). Note that the OA-RAW 
correlation information may be generated and stored in advance. 

The on-air broadcast video correlated information (OA-REL) that 
describes which part of the on-air broadcast video is quoted from which part 

15 of which edited video or raw material video is generated for each on-air 
broadcast video from the OA-ED correlation information and OA-RAW 
correlation information (refer to FIG 3A). 

The edited video correlated information (ED-REL) that describes 
which part of the edited video is used in which part of which on-air 

20 broadcast video, or which part of the edited video is quoted from which part 
of which raw material video is generated for each edited video from the 
OA-ED correlation infonnation and ED-RAW correlation information (refer 
to HQ 3B). 

The raw material video correlated information (RAW-REL) that 
25 describes which part of the raw material video is used in which part of which 
edited video or on-air broadcast video is generated for each raw material 
video from the OA-RAW correlation information and ED-RAW correlation 
information (refer to FIG 3C). 

30 D: Display example of raw material video correlated information 

FIG 5 is a diagram showing a display example of viewing the raw 
material video correlated information. If one raw material video is 
specified, the time of the raw material video is displayed in a display field 
301, and the raw material video correlated information of the specified raw 

35 material video is further referred to display a list of the "correlating video 
identification" and "type" shown respectively in its column numbers 3 and 4 
on a display window 302a. 

Additionally, a display window 302b displays the raw material video 
sections identified from the starting position shown in the colunm number 2 

40 and the number of frames shown in the column number 6 with a mark 
(shadow area in the diagram). More specifically, the display window 302b 
marks which part is used by which correlating video (on-air broadcast video 
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• or edited video) with the time of the raw material video as a horizontal axis, 
while referring to the raw material correlated information. 

In the example shown in FIGS, this raw material video is used in 
three on-air broadcast videos and three edited videos, and sections in which 
5 each raw material video is used are being marked. This shows that a scene 
ranging from 20 minutes to 25 minutes of the raw material video is being 
used in the on-air broadcast video with an identification of 1111 at a glance. 

In the present embodiment, each mark of the sections in which the 
raw material videos are used is displayed in the form of a button, the 
10 correlating videos in question may be displayed on a video viewing window 
with a click of a desired mark through the entry unit 101 such as a mouse. 

E: Display example of edited video correlated information 

FIG 6 is a diagram showing a display example of viewing the edited 

15 video correlated information. If one edited video is specified, the time of 
the edited video is displayed in a display field 401, and a mark is further put 
in the correlating video field of a window 402 in order to visualize the edited 
video section from the starting position shown in the column number 2 to the 
frames long shown in the column number 6. The contents of the mark 

20 include the raw material video identification in a display field 403, typical 
frames of the raw material video section, the frames corresponding to time 
of day, and the like in a display field 404. 

In the present embodiment, each mark of the correlating raw material 
videos is displayed in the form of a button, and the correlating videos in 

25 question may be displayed on a video viewing window with a click of a 
desired mark through the entry unit 101 such as a mouse. 

F: Display example of on-air broadcast video correlated information 

FIG 7 is a diagram showing a display example of viewing the on-air 

30 broadcast video correlated information. If a specified video is the on-air 
broadcast video, it is possible to display the edited video contained in the 
specified on-air broadcast video, and the raw material video used for its 
production. The time of the specified on-air broadcast video is displayed in 
a display field 501, and a mark is further put in the correlating video field of 

35 a window 502 in order to visualize the on-air broadcast video section from 
the starting position shown in the column number 2 to the frames long 
shown in the column number 6. As the contents of the mark, the edited 
video identification may be presented in a display field 503, the raw material 
video identification in a display field 504, and a typical frame of the raw 

40 material video section in a display field 505, respectively. 

In the present embodiment, each mark of the correlating edited 
videos and raw material videos is displayed in the form of a button, and the 
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correlating videos in question may be displayed on the video viewing 
window with a click of a 

desired mark through the entry unit 101 such as a mouse. 

Furthermore, a list of the same type video as the specified video, or a 
5 list of other type videos having a correlation with the specified video may be 
presented together. 

G: Display example of frequency-of-use 

FIG 8 is a diagram showing a display example of viewing the raw 
10 material video correlated information including frequency-of-use 
information. If one raw material video is specified, the time of the raw 
' material video is displayed in a display field 301, and the raw material video 
correlated information of the specified raw material video is further referred 
to display a list of the "correlating video identification" and "type" shown in 
15 the column numbers 3 and 4 thereof on the window 302a, as described 
above. 

In addition, a display window 303 displays the raw material video 
sections identified from the starting position shown in the column number 2 
and the number of frames shown in the colunm number 6 with a mark 

20 (shadow area in the diagram). More specifically, the display window 303 
marks which part is used by which correlating video (on-air broadcast video 
or edited video) with the time of the raw material video as a horizontal axis, 
while referring to the raw material video correlated information. 

In the example shown in FIGS, this raw material video is used in 

25 four edited videos, and sections in which each raw material video is used are 
being marked. This shows a scene ranging from 21 minutes to 26 minutes 
of the raw material video is used, for example, in an edited video with an 
identification of 1111 at a glance. 

Moreover, a display window 304 displays the frequency-of-use for 

30 each fiiame with a vertical axis as the fi:equency-of-use, and with a horizontal 
axis as a time axis. A method of calculating the firequency-of-use will 
hereinafter be described. 

The pointer 305 in FIG 8 may be moved along the time axis with a 
mouse, and the like, and the raw material video at the time of day 

35 corresponding to the position of the pointer on the time axis may be 
displayed on the display unit 102. This function allows the beginning of a 
video to be located at the time position specified by the pointer with viewing 
of the frequency-of-use, so that easy access to a portion witii high (or low) 
frequency-of-use provides increased production efficiency. 

40 

H: Display example of operation screen 

FIG 9 is a schematic view showing an example of the operation 



• screen of the video viewing system according to the present embodiment. 
In an operation screen 601 displayed on the display unit 102, a video 
viewing window 602 displays the video correlating to the identification 
specified by a viewer, and a thumbnail display window 603 displays a list of 

5 the image of the starting position given and images before and after its 
image, together. Specification of a video to view may be directly given by 
the identification of the video through a keyboard of the entry unit 101. 
Additionally, after preparing a list of a video and providing a user with the 
possibility to select the video using a mouse, and the like, the identification 

10 of the selected video may be used. The starting position of the video to 
view may be also entered together. 

Moreover, a related information list display window 604 displays a 
list of the same type video as the specified video, or a list of other type video 
having a correlation with the specified video. A coirelation information 

15 display window 605 displays such correlation information and 
frequency-of-use information as are exemplified in FIG 5 to FIGL 8. 

In this way, correlation information between different video types is 
visualized and the related video lists are also displayed, so that video 
viewing efficiency may be further increased. Additionally, as described 

20 above, a button is provided in the correlation information visualized on the 
correlation information display window 60S, and is specified with a mouse, 
and the like throu^ the entry unit 101, thereby providing easy access to the 
correlating video section. For example, if the frequency-of-use is displayed, 
the raw material video at the corresponding time of day may be displayed on 

25 the video viewing window 602 by moving the pointer 305 to a desired 
position. 

I: Calculation of frequency-of-use 

FIG. 10 is a flow chart showing a procedure for the frequency-of-use 

30 calculation according to the present embodiment. First, the on-air 
broadcast video correlated information (OA-REL), edited video correlated 
information (ED-REL), and raw material video correlated information 
(RAW-REL), which are made to correlate in advance, are stored in the 
correlation information storage unit 108, and then a fi«quency-of-use 

35 counter is reset (Step Al). 

A user specifies a video to view from the entry unit 101 (Step A2). 
In specifying the video to view, the identification may be directly entered, or 
the user may select firom a list of videos displayed in advance. In addition, 
as described above, the video may be specified by selecting a video section 

40 having a correlation or the starting position th^eof from tibe correlation 
information displayed on the correlation information display window 605. 

When the identification of the specified video is identified, the 
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' program control processor 103 directs the video retrieval unit 105 to retrieve 
the desired video in question. The video retrieval unit 105 searches the 
video storage unit 106 by using the specified identification as a clue (Step 
A3). 

5 When a video having the specified identification is found (YES in 

Step A3), the video retrieval unit 105 returns the specified video data to the 
program control processor 103. The program control processor 103 
processes the specified video data before displaying it on the video viewing 
window 602 on the display unit 102 (Step A5). 

10 Subsequently, the program control processor 103 directs the 

correlation information retrieval unit 107 to make retrieval using the 
specified identification. The correlation information retrieval unit 107 
searches the correlation information storage unit 108 by using the specified 
identification as a clue (Step A6), and judges whether correlation 

15 information having the specified identification and still remaining uncounted 
exists or not (Step Bl). And, the frequency-of-use calculation unit 109 
repeats Steps B2 to B4 until all the specified correlation information is 
counted. When all is coimted (NO in Step Bl), the result is graphed and 
displayed (Steps B5 to B6). Hereinafter, the count and graph operation 

20 shown in Steps Bl to B6 will be described with reference to FIG 11 to FIG 
13. 

FIG 11 is a schematic view showing an example of the storage table 
of the raw material video correlated information, FIG 12 being a 
frequency-of-use table showing the result counted for each fiame, FIG 13 

25 being a graph in which the frequency-of-use table of FIG 12 is visualized. 

As shown in FIG 11, the raw material video correlated information is 
stored for each video section of each raw material video in the form shown 
in FIG. 2C. For example, record 1 indicates that four firames long from a 
third frame of a raw material video Al are being used in other videos. 

30 Similarly, record 2 indicates that 10 frames long from a seventh frame of the 
same raw material video Al are being used in other videos. In this way, 
reference to the raw material video correlated information allows for 
identification of which frame of the raw material video Al is being used in 
which video. 

35 In Step Bl of FIG. 10, if correlation information having the 

specified identification and still remaining uncounted exists (YES in Step 
Bl), one unprocessed record of the specified correlation information (here, 
Al) stored in the table shown in FIG 1 1 is read (Step B2). The information 
to be read is the start frame number of the raw material video (column 

40 number 2), and the number of frames of the video section thereof (column 
number 6). 

The frame number of the used raw material video is then identified from the 

15 



• start frame number of the raw material video, and the number of frames of 

the video section thereof. And, the frequency-of-use count corresponding 

to the identified frame numbers respectively is added by one (Step B4). 

The aforementioned Steps B2 to B4 are repeated until all records of the 
5 specified correlation information are counted. This allows each of the 

frequency-of-use to be counted for each used frame of the raw material 

video Al, finally providing a table of the frequency-of-use for each frame 

shown in FIG. 12. 

The thus obtained frequency-of-use table is outputted to the program 
10 control processor 103, subjected to graph processing (Step B5), and 

displayed on the frequency-of-use window 304 shown in FIG 8 as a 

frequency-of-use graph like the one shown in FIG. 13. 

Note that if a video having the identification provided in step A4 is 

not detected, it is judged as being inability to view, and a message, and the 
15 like which show the inability to view will be displayed (Step A9). 

As has been described above, since the first embodiment is 

constructed in such a way that the frequency-of-use information of the 

specified video is generated, visualized, and displayed, the frequency-of-use 

of a video may be easily grasped. 
20 Additionally, in the present embodiment, operation of the pointo: 305 

on the frequency-of-use window as shown in FIG 8 allows for ease of access 

to the frame of a video with high or low frequency-of-use, thus providing 

increased production efficiency. 

In addition, the frequency-of-use may be sorted in ascending order or 
25 in descending order at a stage where the frequency-of-use table shown in 

FIG 12 is obtained, thereby providing further increased ease of access to the 

video with high or low frequency-of-use. 

(Second Embodiment) 

30 In the aforementioned first embodiment, as described with reference 

to FIG. 10, every time a video is specified, a frequency-of-use generation 
unit 109 has calculated the frequency-of-use of the specified video. 
However, according to a second embodiment of the present invention, in 
place of the frequency-of-use generation unit 109 shown in FIG 1, a 

35 frequency-of-use storage unit is set up in a video viewing system, and the 
frequency-of-use information of each video is found and stored in this 
frequency-of-use storage unit in advance. This eliminates the necessity of 
frequency-of-use calculation every time a video is specified, thus enabling 
high-speed processing of the video viewing system. 

40 

(Third Embodiment) 

While in the aforementioned embodiment, an instance where a raw 
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' material video is specified has been described, the system shown in FIG 1 
uses an edited video as well as the raw material video in an on-air broadcast 
video. Accordingly, if the raw material video is specified, £requency-of-use 
information in the edited video and/or on-air broadcast video of the raw 
5 material video may be similarly obtained and visualized (here, making into a 
graph). 

First, the description shown in FIG 2B makes it possible to identify 
that one video section of one edited video correlates to which video section 
of the on-air broadcast video or the raw material video. Also, the 

10 description shown in FIG. 2C makes it possible to identify that one video 
section of one raw material video correlates to which video section of the 
on-air broadcast video or the edited video. 

Therefore, with respect to the raw material video, frequencies used in 
the edited video and the on-air broadcast video may be found, and with 

15 respect to the edited video, frequencies used in the on-air broadcast video 
may be found. In this case, the correlation information on the specified 
identification in Step A6 of the flow chart shown in FIG 10 is just divided 
into a case with the edited video and a case with the on-air broadcast video, 
and the basic operation is similar to that described in the first embodiment 

20 with reference to FIG 10 to FIG 13, so that the detailed d^cription will be 
omitted. 

More specifically, according to the third embodiment, when a 
specified video is the raw material video, raw material correlation 
information is read, and frequencies used in the edited video and the on-air 
25 broadcast video are found with respect to each firame contained in the raw 
nuiterial video to comprise the firequency-of-use information. 

Graphing and displaying such frequency-of-use information allows 
for an easy grasp of the firequency-of-use of a video such that how many 
times which part of the raw material video is quoted in the on-air broadcast 
30 video or the edited video, or such that how many times which part of the 
edited video is quoted in the on-air broadcast video. 

Furthermore, in the present embodiment, a pointer on the time axis of 
a correlation information display window 605 is operated with a mouse, and 
the like, thereby providing ease of access to a portion with high (or low) 
35 firequency-of-use to achieve increased production efficiency. 

In addition, the frequency-of-use is sorted in ascending order or in 
descending order at a stage where the frequency-of-use table shown in FIG 
12 is obtained, thereby providing further increased ease of access to the 
video with high or low frequency-of-use. 

40 

(Fourth Embodiment) 

FIG 14 is a block diagram of a video viewing system according to a 
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• fourth embodiment of the present invention. According to the present 
embodiment, the video retrieval unit 105, the correlation information 
retrieval unit 107, and the frequency-of-use calculation unit 109 shown in 
FIG 1 are implemented in a data processing unit 701 by means of software. 

5 That is, the data processing unit 701 may achieve video viewing functions 
equivalent to those described in the first embodiment to the third 
embodiment by executing a video viewing program 702. An entry unit 101, 
a display unit 102, a video storage unit 106, and a correlation information 
storage unit 108 may be controlled in a similar manner to the first, second, or 

10 third embodiment by means of the data processing unit 701 which executes 
the video viewing program 702, to realize the video viewing system 
according to the present invention. 

Incidentally, while three types of video groups of the raw material 
video, the edited video, and the on-air broadcast video have been described 

15 in the aforementioned embodiments, it goes without saying that they may be 
extended to video groups of more than three types having an interest, for 
example, such a case as the contents, and the like produced by quoting the 
on>air broadcast video are made targets to view. 

As has been described in detail hereinbefore, according to the present 

20 invention, the usage status of a plurality of video groups may be easily 
grasped. More specifically, when a video on the part of being used is 
specified, the Crequency-of-use information is generated, visualized, and 
displayed. For this reason, the usage status of the plurality of video groups 
may be easily grasped. 

25 For example, if three types of video groups of the raw material video, 

the edited video and the on-air broadcast video are stored, and the raw 
material video is specified, frequencies used in the edited video and the 
on-air broadcast video with respect to each frame contained in the raw 
material video are found to comprise the frequency-of-use information. 

30 Furthermore, upon specifying the edited video, frequencies used in the on-air 
broadcast video with respect to each frame contained in the edited video are 
found to comprise the frequency-of-use information. Graphing and 
displaying such frequency-of-use information allows for an easy grasp of the 
frequency-of-use of a video such that how many times which part of the raw 

35 material video is quoted in the on-air broadcast video or the edited video, or 
such that how many times which part of the edited video is quoted in the 
on-air broadcast video. 

Moreover, a pointer is provided on the time axis of a correlation 
information display window and operated with a mouse, and the like, 

40 thereby providing ease of access to a portion with high (or low) 
frequency-of-use to achieve increased production efficiency. 

Also, the calculated frequency-of-use is sorted in ascending order or 
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in descending order, thereby providing further increased ease of access to the 
video with high or low ftequency-of-use. 

Industrial Applicability 

5 The video viewing system and method thereof according to the present 
invention may be applied to everything, and are to be considered as no 
restrictive in the applicability thereof, as far as being a video viewing system 
and method thereof for viewing a desired video from a plurality of videos in 
editing work for video production. 

10 While the present invention has been described by associating with 

some preferred embodiments and examples, it is to be understood that these 
embodiments and examples are merely for illustrative of the invention by an 
example, and not restrictive. While it will be obvious to those skilled in the 
art that various changes and substitutions by equivalent components and 

15 techniques are eased upon reading the specification, it is beHeved obvious 
that such changes and substitutions fit into the true scope and spirit of the 
accompanying claims. 



